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In this paper, we present an implementation of the “Semi Network-Form Game” frame- 
work to predict pilot behavior in a merging and landing scenario. In this scenario, two 
aircraft are approaching to a freeze horizon with approximately equal distance when they 
become aware of each other via an ADS-B communication link that will be available in 
NextGen airspace. Both pilots want to gain advantage over the other by entering the 
freeze horizon earlier and obtain the first place in landing. They re-adjust their speed 
accordingly. However, they cannot simply increase their speed to the maximum allowable 
values since they are concerned with safety, separation distance, effort, possibility of being 
vectored-off from landing and possibility of violating speed constraints. We present how 
to model these concerns and the rest of the system using semi network-from game frame- 
work. Using this framework, based on certain assumptions on pilot utility functions and on 
system configuration, we provide estimates of pilot behavior and overall system evolution 
in time. We also discuss the possible employment of this modeling tool for airspace design 
optimization. To support this discussion, we provide a case where we investigate the effect 
of increasing the merging point speed limit on the commanded speed distribution and on 
the percentage of vectored aircraft. 


Nomenclature 


Ai i th Aircraft 

v® The initial velocity of Ai 

v\ The new velocity of Ai commanded by the pilot 
Xi The initial distance of Ai to the merging point 
di The final distance of Ai to the merging point 


I. Introduction 

Human decision-makers play a major role in the operation of most real-world systems of today. In most 
cases, the successful operation of these systems often hinge upon the sound judgement of few individuals. For 
example, pilots and air traffic controllers continuously make decisions that determine the safety and operation 
of the National Airspace System (NAS). Even if replacing the humans with automation is conceivable, it will 
be many decades before the dependence on human decision-making becomes negligible. Since humans play 
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such a crucial role in characterizing real-world systems, it follows that to make any accurate predictions about 
system behavior requires a model that is capable of capturing both the human and non-human dynamics of 
the system. 

Combining ideas from game theory and computer science, the “Semi Network-Form Game” 1 framework 
can be used not only to model multiple human decision-makers and physical systems, but also to capture their 
interactions. For example in their paper, 1 the authors used the framework to model pilot behavior during 
mid-air encounters. A semi network- form game (or “semi net-form game”) uses a specific type of probabilistic 
graph, called a Bayesian network, 2 as the underlying probabilistic framework, consequently representing all 
parts of the system using random state variables. Non- human components such as automation and physical 
systems are described by traditional probability nodes (called “chance nodes”), i.e., nodes that have their 
conditional probability distributions pre-specified. Human decisions are represented by special nodes (called 
“decision nodes”) that have their conditional probabilities left unspecified. Instead, these nodes are each 
associated with a utility function, 3 i.e., a function that summarizes the preferences of a decision-maker 
into a single “happiness” metric. The notion is that humans do not act according to a fixed conditional 
probability distribution, but rather choose their actions in attempt to maximize their utility. However, one 
difficulty arises when there are multiple competing decision-makers. How do we decide whether a single 
utility is maximized or if there is a compromise? To answer this question, semi net-form games turn to 
the game theory literature, where researchers have found simple mathematical models, called “solution 
concepts”, that accurately modeled interacting human behavior in past experiments. 4-6 Combining Bayes 
nets, solution concepts, and statistical techniques, Lee and Wolpert created an algorithm, called “Level-K 
d-relaxed strategies”, 1 that efficiently estimates the behavior of a semi net-form game model. 

LibNFG is a NASA open source software library that implements the semi net-form game framework 
and its estimation algorithms. The software, written in C++, allows the user to specify all aspects of a 
semi net-form game model including topology, node behavior, and utility functions, and computes sample 
estimates of the system behavior. In this paper, we demonstrate how to apply a semi net-form game to model 
a merging and landing scenario set in a future airspace, and analyze the prediction results. In addition, we 
discuss how this approach can be used to optimize airspace scenarios. As an example, we provide quantitative 
predictions on how relaxing merging point speed constraint effects the number of vectored aircraft and the 
final distance between the aircraft, in the merging and landing scenario. These kind of predictions can be 
utilized in an optimization routine by the system designer to achieve optimum system parameters that will 
satisfy the design goals and constraints. 

II. Merging and Landing Scenario as a Semi Net-Form Game 

In the existing system, aircraft are controlled through different sectors by various ground controllers, 
until they arrive at the “freeze horizon”. After entering the freeze horizon, the aircraft become eligible for 
sequencing by the airport ground controller based on a “first come first serve” (FCFS) principle. 7 In the 
Next Generation (NextGen) airspace, the aircraft are supposed to have ADS-B data-link, via which they will 
be able to receive other aircraft information such as aircraft ID, position and velocity. In the scenario we 
want to investigate, we assume that two aircraft are converging to the freeze point and they each realize, via 
ADS-B, that there is another aircraft at an approximately equal distance to the freeze horizon (see Fig. 1). 
Since they are aware of the FCFS procedure, they would like to use this new ADS-B technology to obtain 
the first place in the landing sequence without creating a safety hazard. 

A. Scenario Description 

We model the merging and landing scenario as follows: 

1. At time equal to to, the aircraft have velocity u 6 and position X{. 

2. At time equal to to, pilots realize that there is another aircraft close to the freeze horizon and they 
simultaneously decide (and act) to adjust their speed to v f . 

3. When the new velocity vf is commanded to the flight controller, the aircraft reaches to this velocity 
through a first order dynamics. 

4. The ground controller first observes these two aircraft on her radar screen at time to + travel 
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Figure 1. Two aircraft converging to the freeze horizon 


5. When the ground observes the aircraft, she determines whether or not to vector the aircraft off from 
landing. The ground deterministically decides whether to vector-off ( VOFF = 1 ) or not ( VOFF = 0) 
based on the following rule: 


VOFFi = 1 1 



0 otherwise 



where c and t* are a known constant and a threshold time value. 


(i) 


It is noted that in ( 1 ), the expression inside the parenthesis is the difference between the estimated 
time of arrivals (ETA) of the Aircraft to the merging point when they are first observed by the ground. 
According to this rule, if the ETA of A i to the merging point is close to the ETA of the other aircraft so 
that |ETA^ — ETAj| < t* then it is vectored regardless of whether it has a higher ETA or not. However, if 
Ai manages to get ahead more than t* seconds, then it will not be vectored off. On the other hand, if it 
falls behind only so much so that ct* > (ETA^ — ETAj) > t* it will still be vectored off. So the pilots should 
strategize in such a manner that they should keep their ETA different from the other aircraft but if they 
have to keep it close, then they should be a certain time seconds ahead not to be vectored off. 

It is assumed that the merging lines in Fig. 1 are orthogonal and therefore the distance between the 
aircraft when they are first observed by the ground can be calculated as 

d = sjd\+d\. ( 2 ) 


B. Graphical Model 

The graphical model, shown in Fig. 2, specifies the relationships between system variables of the merging 
and landing scenario. In this figure, the true state of Aircraft 1, [xi,r>i] is represented by node Si and the 
true state of Aircraft 2 , [# 2 ,^ 2 ] is represented by node 62 - These are initialized from a uniform distribution 
with ranges [220 — 270] in nautical miles and [340 — 420] in knots, along their trajectories. Although the pilots 
know their own aircraft’s state, they observe the other aircraft’s state through a noisy observation node. 
The observations obtained through ADS-B data-link are represented by the nodes which will be 

the same as the true states but with additive observation noise. Pilots, P*, use these observations, together 
with their beliefs about the other pilot’s and the ground’s decisions, to decide new speed commands v\ to 
the autopilot controllers. Using the true states and pilot’s moves, the aircraft motion is then simulated to 
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Figure 2. Bayes net diagram of a merge and land scenario 


obtain the outputs, [di,v{], which is represented by the node F. Finally, the ground observes the resulting 
aircraft states and decides whether to vector off an aircraft ( VOFF = 1) or not ( VOFF = 0). 

C. Aircraft Model 

The aircraft in this scenario is being controlled by the auto-pilot which is in velocity control mode. In this 
mode, the pilot command the velocity v c and the autopilot drives the aircraft to the desired speed. It is 
assumed that the closed loop system which has the pilot command as the input and the aircraft velocity as 
the output is represented with a first order dynamics that has a 33-second time constant. This time constant 
is obtained from NASA’s Generic Transport Model (GTM) which represents a generic large transport aircraft 
together with a conventional autopilot. Therefore, the aircraft speed change can be given by the following 
equation. 


Vi 33 Vi 


33 


(3) 


The aircraft are assumed to be perfectly following the merging path lines and therefore only the motion on 
these lines are considered. Therefore, the relation between the initial positions Xi and the final positions di 
can be given as 

rto+At 

di = Xi - / Vi(a)da (4) 

Jt 0 


where At is assumed to be 900 seconds. 


D. Pilot Utility Functions 

Pilot utility functions summarize pilot preferences about different states of the system into a single metric. 
For the merging and landing scenario, it is assumed that the following factors plays a role in pilots’ decisions: 
Estimated Time of Arrival: Pilots want to arrive to the airport as soon as possible. To achieve this 
goal, they try to minimize their estimated time of arrival which is roughly proportional to the distance di of 
the aircraft to the merge point when they are first observed by the ground. 
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Aircraft Separation: Pilots want to prevent an unsafe situation and therefore they want to keep the 
separation between each other as much as possible. Therefore, they try to maximize d (see Fig. 1). 

Possibility of Being Vectored Off: Pilots do not want to be vectored-off from landing because it 
delays their arrival, causes extra fuel burn and requires additional effort and inconveniences. Thus the pilot 
will choose actions that try to make the ground decide against vectoring-off. The variable that represents vec- 
toring off decision is VOFF , which takes the values 0 and 1, representing “not vectoring off’ and “vectoring 
off’, respectively. 

Effort: If possible, pilots do not want to do anything and keep their speed unchanged to minimize effort. 
Therefore, they will try to minimize |?; 0 — v c \. 

Violating the Merging Point Constraint: The pilots are supposed to have a certain speed v* at the 
merging point. Therefore, the more they deviate from that speed the harder it will be to satisfy the constraint 
in the remaining time after they are first observed by the ground. Since the environment is uncertain, it 
is not clear what the “maximum safe speed” is while passing through the freeze horizon. Therefore, pilots 
try to adjust their speed as close as possible to t?*, without having a clear idea how much they can deviate 
from it safely. As the deviation magnitude increases, the probability of violating the constraint increases, 
which increases the nervousness of the pilots. However, increasing the speed beyond a certain value will have 
negligible additional effect. We will model this dependency using a hyperbolic tangent function with certain 
constants to have it positive everywhere and to represent reasonable speed ranges. 

Summing all the above mentioned terms, the pilot utility function is given as 

Ui = —uJidi + l jj 2 d — UJ 3 VOFF — wily® — v?\ — l ^tanh — v*)l R +(v% — v*) — 3^ — tanh(— 3)^ (5) 

III. Results and Discussion 

Various simulation results are presented in Fig. 3, where each plot represents a case with certain initial 
aircraft states. Black and red circles represent aircraft at time t = to and t = to + At, respectively. In these 
simulations, we used At = 9005. The green line represents the freeze horizon. On the bottom left and right of 
the figures the utilities achieved by the pilots are given together with individual components constituting the 
utilities. “uETO”, “uLOS”, “uVOFF”, “uEfrt” and “uViolt” represent the utility components corresponding 
to Estimated Time of Arrival, Loss Of Separation, Vectoring OFF, Effort and Violation of merging point 
constraint, respectively. Values inside the parenthesis next to each utility component value represent the 
corresponsing utility weights. Same weights are used in all simulations. The constants in (1) are selected 
as t* = 2 (minutes) and c = 2. Individual utility components are normalized with their maximum possible 
values during the simulations to obtain order of magnitude comparable utility components. For presentation 
purposes, the resulting values are multiplied by 100 to give percentage values. 

In the figures, x and v next to the aircraft are representing the aircraft distance to the merging point 
and aircraft velocity, respectively. For example, in Fig. 3-c, the aircraft on the left (first aircraft) starts 
with a distance of 226 nmi to the merging point with a speed of 350 knots while the other aircraft (second 
aircraft) has 233 nmi and 394 knots as its initial conditions. When they both observe each other, albeit 
noisily, the first pilot decides to lower her speed by 3 knots to 347 knots and the second pilot decides to 
lower her speed by 8 knots to 386 knots. After 15 minutes, these decisions lead the first aircraft to a position 
where it’s 136 nmi away from the merging point while the second aircraft ends up being 133 nmi away. With 
these final positions and speeds, the first pilot achieves a “-13” utility value, or “happiness index”, while 
the other pilot scores “+6” points. The individual utility component analysis reveals that although the first 
pilot achieved higher scores in terms of estimated time of arrival (ETA), effort and constraint violation, her 
score is less than the other pilot because she is vectored off from landing which decreased her total score by 
a 100 * 0.4 = 40 points. The reason she is vectored off is that both aircraft has approximately equal ETA 
to the merging point, which creates a potential conflict, but the first aircraft has a little bit higher ETA, 
which made the air traffic controller decide that it is safer to let the second aircraft continue it’s path and 
vector-off the first aircraft. It is noted that these simulation results are a result of certain assumptions for 
the initial configurations, vectoring-off criteria, utility function components and merging point constraints. 
These assumptions can be modified to make the related simulations more realistic. What is emphasized in 
this work is that once these assumptions are set, based on real data and pilot interviews, the semi net-form 
game formalism is capable of making predictions on the overall system evolution where human decision plays 
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a critical role. The individual parameters in utility functions, such as weights, can also be estimated by using 
real data via machine learning methods. 

The approach presented in this paper can be utilized for flight safety studies such as predicting the 
percentage of potential collisions, identifying safe separation distance for the aircraft before entering the 
freeze horizon together with safe speed ranges. In addition, performance predictions such as the percentage 
of vectored aircraft or average landing times can be obtained. Figure 4 shows the results of an example study 
where the effect of relaxing the merging point speed constraint on system outcome is investigated. When 
the merging point speed constraint is relaxed (increased) 20%, the distribution of the commanded speed by 
the first pilot (vl-c) is more uniform, compared the the default case, where the pilot chooses small speeds 
more frequently, as expected. The number of vectored aircraft decreases from 211 to 135, a 36% drop. This 
may be due to the fact that since the pilots have more freedom to choose their speeds, they used this extra 
degree of freedom to prevent vectoring. 


IV. Conclusion 

In this paper semi net-form game formalism is implemented to predict a merging and landing scenario, 
where two aircraft pilots observe each others’ states via an ADS-B communication link, while approaching 
a freeze horizon. Pilots want to arrive the freeze horizon first to gain the first place in landing to save time, 
but they also consider safety, effort, merging point constraint violation before they make their decision of the 
new speed command they give to the autopilot. Using certain assumptions about the system configuration 
and pilot utility functions, a prediction of the system evolution in time is provided. As seen in the simulation 
results, net-form game formalism provides a powerful analysis tool and can also be used to optimally design 
the airspace. In addition, net-form game formalism provides a modular, fully probabilistic modeling capacity 
with reasonable computational cost. 
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(a) Al: { 226nmi, 343knots}, A2: { 250nmi, 419knots} (b) Al: { 240nmi, 348knots}, A2: { 233nmi, 405knots} 
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(c) Al: { 226nmi, 350knots}, A2: { 233nmi, 394knots} (d) Al: { 246nmi, 399knots}, A2: { 234nmi, 408knots} 
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Figure 3. Various cases with different initial aircraft states 
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Figure 4. Effects of relaxing the merging point speed constraint by 20% 
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